Incremental Verification of Neural Networks

نویسندگان

چکیده

Complete verification of deep neural networks (DNNs) can exactly determine whether the DNN satisfies a desired trustworthy property (e.g., robustness, fairness) on an infinite set inputs or not. Despite tremendous progress to improve scalability complete verifiers over years individual DNNs, they are inherently inefficient when deployed is updated its inference speed accuracy. The inefficiency because expensive verifier needs be run from scratch DNN. To efficiency, we propose new, general framework for incremental and based design novel theory, data structure, algorithms. Our contributions implemented in tool named IVAN yield overall geometric mean speedup 2.4x verifying challenging MNIST CIFAR10 classifiers 3.8x ACAS-XU state-of-the-art baselines.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Verification of Binarized Neural Networks

We study the problem of formal verification of Binarized Neural Networks (BNN), which have recently been proposed as a energyefficient alternative to traditional learning networks. The verification of BNNs, using the reduction to hardware verification, can be even more scalable by factoring computations among neurons within the same layer. By proving the NP-hardness of finding optimal factoring...

متن کامل

Incremental Construction of Projection Generalizing Neural Networks

In many practical situations in NN learning, training examples tend to be supplied one by one. In such situations, incremental learning seems more natural than batch learning in view of the learning methods of human beings. In this paper, we propose an incremental learning method in neural networks under the projection learning criterion. Although projection learning is a linear learning method...

متن کامل

Incremental Learning of Convolutional Neural Networks

Convolutional neural networks provide robust feature extraction with ability to learn complex, highdimensional non-linear mappings from collection of examples. To accommodate new, previously unseen data, without the need of retraining the whole network architecture we introduce an algorithm for incremental learning. This algorithm was inspired by AdaBoost algorithm. It utilizes ensemble of modi...

متن کامل

Incremental Training of Deep Convolutional Neural Networks

We propose an incremental training method that partitions the original network into sub-networks, which are then gradually incorporated in the running network during the training process. To allow for a smooth dynamic growth of the network, we introduce a look-ahead initialization that outperforms the random initialization. We demonstrate that our incremental approach reaches the reference netw...

متن کامل

Adaptive incremental learning in neural networks

Adaptation plays a central role in dynamically changing systems. It is about the ability of the system to “responsively” self-adjust upon change in the surrounding environment. Like in living creatures that have evolved over millions of years developing ecological systems due to their self-adaptation and fitness capacity to the dynamic environment, systems undergo similar cycle to improve or at...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ACM on programming languages

سال: 2023

ISSN: ['2475-1421']

DOI: https://doi.org/10.1145/3591299